Assessing the fidelity of a behavioural intervention involving academic detailing in general practice: a sub-study of the 'Implementing work-related Mental health guidelines in general PRacticE' (IMPRovE) trial.

BACKGROUND: Assessing the fidelity of intervention components enables researchers to make informed judgements about the influence of those components on the observed outcome. The 'Implementing work-related Mental health guidelines in general PRacticE' (IMPRovE) trial is a hybrid III trial aiming to increase adherence to the 'Clinical Guidelines for the diagnosis and management of work-related mental health conditions in general practice'. IMPRovE is a multifaceted intervention, with one of the central components being academic detailing (AD). This study describes the fidelity to the protocol for the AD component of the IMPRovE intervention. METHOD: All AD sessions for the trial were audio-recorded and a sample of 22% were randomly selected for fidelity assessment. Fidelity was assessed using a tailored proforma based on the Modified Conceptual Framework for fidelity assessment, measuring duration, coverage, frequency and content. A descriptive analysis was used to quantify fidelity to the protocol and a content analysis was used to elucidate qualitative aspects of fidelity. RESULTS: A total of eight AD sessions were included in the fidelity assessment. The average fidelity score was 89.2%, ranging from 80 to 100% across the eight sessions. The sessions were on average 47 min long and addressed all of the ten chapters in the guideline. Of the guideline chapters, 9 were frequently discussed. The least frequently discussed chapter related to management of comorbid conditions. Most general practitioner (GP) participants used the AD sessions to discuss challenges with managing secondary mental conditions. In line with the protocol, opinion leaders who delivered the AD sessions largely offered evidence-based strategies aligning with the clinical guideline recommendations. CONCLUSIONS/IMPLICATIONS: The IMPRovE AD intervention component was delivered to high fidelity. The sessions adhered to the intended duration, coverage, frequency, and content allowing participating GPs to comprehend the implementation of the guideline in their own practice. This study also demonstrates that the Modified Conceptual Fidelity Framework with a mixed methods approach can support the assessment of implementation fidelity of a behavioural intervention in general practice. The findings enhance the trustworthiness of reported outcomes from IMPRovE and show that assessing fidelity is amenable for AD and should be incorporated in other studies using AD. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry ACTRN 12620001163998, November 2020.

Differences Over Time in the Prognostic Effect of Return to Work Self-Efficacy on a Sustained Return to Work.

Purpose This study investigated the association between return to work self-efficacy (RTW-SE) and sustained return to work (RTW) at two different time points, over a 12-month period. The primary objective of the study was to examine if the relationship between RTW-SE and a sustained RTW changed over the RTW timeline. Methods This study used survey responses from a longitudinal cohort of n = 410 workers' compensation claimants with either an upper-body musculoskeletal injury or a psychological injury. A path analysis tested the associations between RTW-SE and a sustained RTW at two time-points. A Wald χ2 test compared nested models to determine if the association changed over time. Results RTW-SE measured at time- point 1 (T1) was associated with a sustained RTW at time-point two (T2) (ß = 0.24, P < 0.05) but no association was found between RTW-SE at T2 and a sustained RTW at time-point three (T3) (ß = 0.017, n.s.). Model comparisons revealed significant differences in the associations between RTW-SE and a sustained RTW, with the relationship being stronger in the early phase of RTW compared to the latter phase (χ2 = 5.002, p = 0.03). Conclusions The results indicate that RTW-SE at 4-6 months post-injury is important for a sustained RTW 6-months later although RTW-SE at 10-12 months post-injury had a negligible association over the same duration. Further research should investigate whether these findings generalize to other populations and what factors other than RTW-SE are associated with RTW in the later stages of the RTW process.

The Effect of Self-Efficacy on Return-to-Work Outcomes for Workers with Psychological or Upper-Body Musculoskeletal Injuries: A Review of the Literature.

Purpose Work absence can result in substantial losses to the economy and workers. As a result, identifying modifiable factors associated with return-to-work (RTW) following an injury or illness is the focus of many empirical investigations. Self-efficacy, the belief about one's ability to undertake behaviours to achieve desired goals, has been identified as an important factor in RTW for injured workers. This paper systematically reviewed the literature on the association between self-efficacy and RTW outcomes for workers with an upper-body musculoskeletal injury or psychological injury. Methods A systematic search was conducted across five databases using two main search concepts- 'self-efficacy' and 'RTW'. After removing duplicates, our search strategy identified 836 studies, which were screened for relevance using titles and abstracts. Results A two stage screening process reduced the study pool to six studies using psychological injury cohorts and three using upper-body musculoskeletal (UB-MSK) cohorts. Eight cohorts from seven prospective cohort studies and one sample from a randomised control trial (RCT) were subjected to a risk of bias assessment. Higher levels of self-efficacy appeared to have a consistent and positive association with RTW across return-to-work status and work absence outcomes, injury type and follow-up periods. Effect ratios ranged from 1.00 to 5.26 indicating a potentially large impact of self-efficacy on RTW outcomes. The relationship between self-efficacy and RTW strengthened as the domain of self-efficacy became more specific to RTW and job behaviours. Studies assessing workers with psychological injuries were of a lower quality compared to those assessing workers with UB-MSK injuries. Conclusions Higher self-efficacy had consistent positive associations with RTW outcomes. Further empirical research should identify the determinants of self-efficacy, and explore the processes by which higher self-efficacy improves RTW outcomes.

Early-Claim Modifiable Factors Associated With Return-to-Work Self-Efficacy Among Workers Injured at Work: Are There Differences Between Psychological and Musculoskeletal Injuries?

OBJECTIVE: The objective of this study was to investigate modifiable early-injury factors which are associated with self-efficacy to return-to-work (RTW-SE) and explore whether these factors are different for people with psychological or upper-body musculoskeletal (UB-MSK) injuries. METHODS: The study used a sample of workers with a UB-MSK (N = 244) or psychological (N = 113) injury who were off work. Differences between injury types were investigated across variables related to: (1) communication with RTW stakeholders; and (2) components of the job itself. A stratified and multigroup analysis was conducted using structural equation modeling (SEM). RESULTS: Injury-stratified models revealed no significant differences. In a combined model, higher job autonomy and low-stress contact from the RTW coordinator remained significantly associated with higher RTW-SE. CONCLUSIONS: Job autonomy and low-stress contact from the RTW coordinator are possible areas to target to increase self-efficacy among injured workers.

Practice effects associated with the repeated assessment of cognitive function using the CogState battery at 10-minute, one week and one month test-retest intervals.

There are many situations in which cognitive tests need to be administered on more than two occasions and at very brief test-retest intervals to detect change in group performance. However, previous literature has not specifically addressed these important issues. The main aim of the current study was to examine these two factors by using a computerized cognitive battery designed specifically for the repeated assessment of cognition (i.e., CogState) in healthy young adult individuals. A further aim of the study was to examine how many times the battery needed to be completed before performance, as measured by the battery, stabilized. Forty-five adults (age range: 18-40 years) completed the battery four times at 10-minute test-retest intervals, and a fifth time at an interval of one week. The results illustrated that when brief test-retest intervals were used (i.e., 10 minutes), performance stabilized after the second assessment, as significant practice effects were generally observed between the first and the second assessments. Practice effects were also observed on some of the tasks at a one-week test-retest interval. Due to these findings, 55 adults (age range: 18-40 years) completed the battery twice at 10-minute test-retest intervals (i.e., to eliminate the initial practice effect), and a third time at an interval of one month. No practice effects were observed. The implications of the results are discussed in terms of methods that can be adopted in order to minimize practice effects when this particular cognitive battery is used.

Repeated assessment of cognition in children and the measurement of performance change.

There is limited understanding of the problems associated with repeated neuropsychological assessment in children, including the statistics used to guide decisions about cognitive change. This study investigated the utility of a computerized assessment battery that was specifically designed for the repeated assessment of cognitive function in children. Eighty-seven participants aged 8 to 12 years completed the battery four times within a 2-hour testing session. The results support the application of this assessment battery for measuring cognitive change in children. A novel method for calculating measurement error is employed, and its use in the detection of cognitive change in individual children is discussed. An estimate of the measurement error within each of the tests is provided, and recommendations are made regarding the application of this assessment battery for measuring cognitive change in children.

Cognition in liver disease.

BACKGROUND: Cognitive dysfunction has been observed in a range of liver diseases including chronic hepatitis C virus, alcoholic liver disease, primary biliary cirrhosis and Wilson's disease. Such dysfunction may range from mild cognitive changes to overt hepatic encephalopathy, and represents a significant complication of liver disease that may negatively impact the patient's quality of life, and normal activities of daily living (e.g., driving). METHOD: This article reviews the published evidence relating to cognitive dysfunction in liver disease. OUTCOME: Issues of definition, diagnosis, epidemiology, aetiology, treatment and outcome are discussed. Particular attention is devoted to identifying the mild cognitive changes that occur in liver diseases of different aetiology.

Qualitative similarities in cognitive impairment associated with 24 h of sustained wakefulness and a blood alcohol concentration of 0.05%.

Previous studies that have quantified fatigue-related cognitive impairment as blood alcohol concentration (BAC) equivalents have been limited by two issues: the effect of practice on tests of cognition and, more importantly, the statistic used to quantify change in cognitive performance. The current study addressed these issues by adopting an ABACA design, which allowed for the adequate control of practice effects, and by using effect size metrics, which enabled direct comparisons to be made in performance impairments as a result of fatigue (i.e. sustained wakefulness of 24 h) and alcohol (i.e. BAC of 0.05%). Cognitive performance under the fatigue and alcohol conditions required the use of the CogState battery. It was demonstrated that fatigue caused greater impairment than alcohol on the speed of continuous attention and memory and learning, and on the accuracy of complex matching. Alcohol was more detrimental than fatigue only on the accuracy of memory and learning. Performances on the remaining tasks were the same for both the fatigue and alcohol conditions. These differences and similarities in performance impairment are discussed emphasizing the deleterious cognitive effects of relatively short periods of sustained wakefulness.

The effects of practice on the cognitive test performance of neurologically normal individuals assessed at brief test-retest intervals.

Performance on many cognitive and neuropsychological tests may be improved by prior exposure to testing stimuli and procedures. These beneficial practice effects can have a significant impact on test performance when conventional neuropsychological tests are administered at test-retest intervals of weeks, months or years. Many recent investigations have sought to determine changes in cognitive function over periods of minutes or hours (e.g., before and after anesthesia) using computerized tests. However, the effects of practice at such brief test-retest intervals has not been reported. The current study sought to determine the magnitude of practice effects in a group of 113 individuals assessed with an automated cognitive test battery on 4 occasions in 1 day. Practice effects were evident both between and within assessments, and also within individual tests. However, these effects occurred mostly between the 1st and 2nd administration of the test battery, with smaller, nonsignificant improvements observed between the 2nd, 3rd, and 4th administrations. On the basis of these results, methodological and statistical strategies that may aid in the differentiation of practice effects from drug-induced cognitive changes are proposed.

CogSport: reliability and correlation with conventional cognitive tests used in postconcussion medical evaluations.

OBJECTIVE: To determine the repeatability of a computerized cognitive test designed to monitor recovery from concussion and assist team physicians make return to play decisions (CogSport). To determine the correlation between CogSport and two conventional neuropsychological tests. DESIGN: Prospective, serial investigation of cognitive function. SETTING: Professional and semi-professional Australian Football clubs and a university affiliated research institute in Melbourne, Australia. PARTICIPANTS: Three-hundred healthy young adults, including 240 elite athletes. MAIN OUTCOME MEASURES: Intra-class correlation (ICC) coefficients for CogSport performance measures administered serially. ICC between CogSport performance measures and conventional neuropsychological tests. Normative data for CogSport performance measures. RESULTS: Measures of psychomotor function, decision making, working memory and learning were highly reliable. Some measures also displayed high correlations with conventional neuropsychological tests of information processing and attention. Preliminary normative data is described. CONCLUSIONS: CogSport is a highly reliable cognitive function test when administered to healthy young adults and elite athletes. CogSport measures similar cognitive functions as conventional tests used commonly in concussion research.

Behavioral characterization of mild cognitive impairment.

Results from recent investigations of behavioral and genetic outcomes in older people with mild cognitive impairment (MCI) have been inconsistent. These conflicting results may be attributed to between-study differences in the diagnostic systems employed, as well as the use of unreliable neuropsychological measures. We investigated behavioral and genetic outcomes in older people classified as having MCI according to novel criterion that required evidence of cognitive impairment on three consecutive neurological/neuropsychological assessments. One hundred and seventy four healthy older people were evaluated semi-annually for 12 months. Of these, 23 subjects were rated as having MCI on three consecutive assessments and were compared to 23 matched control subjects. Subjects rated as impaired on one or two of the three semi-annual assessments were also identified. MCI and matched control groups were compared on a range of behavioral measures. The prevalence of the Apolipoprotein E4 (ApoE4) allele was determined in all groups, and estimates of anxiety and depressive symptomatology were obtained. Subjective cognitive complaints were also assessed. Many subjects were classified as impaired on one or two assessments, however relatively few (n = 23) recorded consistent cognitive deficits. The most severe impairment observed in MCI subjects was on a test of pattern-location associative learning, however MCI subjects did not have insight into this impairment. The prevalence of the ApoE4 allele was not different between matched control and MCI groups. These results indicate that individuals with MCI can be differentiated from healthy older people and older people with transient cognitive impairments, but that such differentiation requires serial assessment of cognitive function.

Determining the extent of cognitive change after coronary surgery: a review of statistical procedures.

Currently, cognitive decline after coronary surgery is said to be significant if the individual's postoperative test score is at least 1 standard deviation (SD) worse than their preoperative score. This "1-SD" technique fails to account for factors that may confound interpretation of serially acquired cognitive test scores, including regression to the mean, measurement error caused by poor test-retest reliability, and practice effects. We review the many alternative and potentially superior statistical techniques that have been described in the neuropsychologic and psychiatric literature for differentiating "true" changes in cognitive test score from changes caused by these factors.

An analysis of systems of classifying mild cognitive impairment in older people.

OBJECTIVE: Over the past two decades, a number of systems have been developed for the classification of cognitive and behavioural abnormalities in older people, in order that individuals at high risk of developing neurodegenerative disease, particularly Alzheimer's disease, may be identified well before the disease manifests clinically. This article critically examines the inclusion and exclusion criteria of a number of such classification systems, to determine the effect that variations in criterion may have on clinical, behavioural and neuroimaging outcomes reported from older people with mild cognitive impairment. METHOD: Qualitative review of the literature describing systems of classifying mild cognitive impairment, and outcomes from clinical, behavioural, neuroimaging and genetic studies of older people with mild cognitive impairment. RESULTS: The exclusion and inclusion criteria for these classification systems vary markedly, as do the design of studies upon which the validity of these systems has been assessed. Minor changes to individual exclusion/inclusion criterion may result in substantial changes to estimates of the prevalence and clinical outcome of mild cognitive impairment, while inadequate experimental design may act to confound the interpretation of results. CONCLUSIONS: As a result of these factors, accurate and consistent estimates of the outcome of mild cognitive impairments in otherwise healthy older people are yet to be obtained. On the basis of this analysis of the literature, optimal criteria via which accurate classifications of mild cognitive impairment can be made in future are proposed.

Selectively impaired associative learning in older people with cognitive decline.

Older people with declining cognitive function typically display deficits in declarative memory processes, often most evident on tests of associative learning (AL). The hippocampal formation (HF) is thought to be critically involved in the encoding and retrieval of such associations, consistent with neuroimaging findings that the HF is damaged in early stages of neurodegenerative disease and in older people with AL impairments. In the clinic, older people with cognitive decline commonly report difficulties associating names with faces. However, we have observed that such people are particularly impaired on tests requiring the association of novel stimuli. In Experiment 1, a series of AL tasks were administered to older people with cognitive decline to determine whether they were impaired at simply making associations, or at making associations between novel stimuli. In Experiment 2, we measured HF function in these subjects by administering an AL task designed to differentiate between HF-damaged and HF-intact individuals. Our experimental protocols were guided by a computational model of HF function in AL described by Gluck and Myers (1997). Older people with cognitive decline displayed impaired performance on tasks designed to be highly dependent upon intact HF function, including a task in which novel patterns and spatial locations were to be associated. These results suggest that the AL impairments observed in older people with cognitive decline may be due to HF dysfunction.